Co-ordinating Heterogeneous Parallel Computation

There is a growing interest in heterogeneous high performance computing environments. These systems are diicult to program owing to the complexity of choosing the appropriate resource allocations and the diiculties in expressing these choices in traditional parallel languages. In this paper we propose a methodology for structured parallel programming using functional skeletons to express these resource allocation strategies. By associating performance models with each skeleton it is possible to predict and opti-mise the performance of diierent resource allocation strategies, thus providing a tool for guiding the choice of resource allocation. Through a case study of a parallel conjugate gradient algorithm on a mixed vector and scalar parallel machine we demonstrate these features of the SPP(X) approach.